Ultra-Fast Generation of True Random Numbers Using Hybrid Boolean Networks 



(N 

o 

> 
O 



U 
d 



(N 
> 



ov 

o: 



David P. Rosin, 1:2 Damicn Rontani 1 and Daniel J. Gauthier 1 

1 Department of Physics, Duke University, Department of Physics, Durham, North Carolina 27708, USA 
2 Institut fur Theoretische Physik, Technische Universitdt Berlin - Hardenbergstr. 36, D-10623 Berlin, Germany 

(Dated: November 20, 2012) 

We describe a high-speed true random number generator based on a hybrid Boolean network with 
autonomous and clocked logic gates, realized on a reconfigurable chip. The autonomous logic gates 
are arranged in a bidirectional ring topology and generate broadband chaos. The clocked logic gates 
receive input from the autonomous logic gates so that true random numbers are generated that 
pass standard randomness tests without further post-processing. The large number of logic gates on 
reconfigurable chips allows for parallel generation of true random numbers, as demonstrated by our 
implementation of 128 random number generators that achieve a real-time bit rate of 12.8Gbit/s. 

PACS numbers: 05.45. Gg, 64.60.aq, 05.45.-a 



True random numbers guarantee the integrity of cryp- 
tographic protocols used in secure communications [lj 
and the accuracy of Monte-Carlo simulations used in cli- 
mate or biomedical sciences 0]. They can only be ex- 
tracted from physical entropy sources, such as quantum 
fluctuations 0, 0| and electrical noise Q , as opposed to 
pseudo-random numbers that are obtained from deter- 
ministic mathematical algorithms. Recently, it was found 
that chaotic dynamics in the presence of constant pertur- 
bation by microscopic noise can also be used to generate 
true random numbers 0, 0| ■ With this approach, real- 
time rates of ~ 2 Gbit/s have been achieved d, @|. 

The generation of true random numbers presents chal- 
lenges because of intrinsic bias (non-identical proportion 
of "0" and "1") and correlations originating from the 
physical source. Both effects diminish the quality of the 
random numbers, resulting in failure of statistical ran- 
domness tests [l0( . Bias and correlations can be reduced 
using post-processing, such as by combining multiple bit 
streams from identical uncoupled systems or hashing ran- 
dom bits from the bit stream produced by a single device 
0, [|| . The downside of these approaches is an increase 
in the number of devices or a decrease in the bit rate, re- 
spectively. In most studies of ultra-fast random number 
generation, the post-processing is often performed off-line 
[7| because of technological limitations so that the actual 
generation rate of high-quality random numbers is much 
lower. Other challenges include scalability to higher rates 
and interfacing with computing and communication ar- 
chitectures, which have triggered recent developments of 
monolithically-integrated devices 

Chaotic photonic devices have dominated the research 
on the high-speed generation of true random numbers be- 
cause of their large bandwidth, which enables very high 
data rates Q . Recently, experiments have demonstrated 
that broadband chaos can also be generated by circuits 
of autonomous logic gates, which do not rely on a clock. 
These electric circuits are also promising candidates for 
random number generation because they can be imple- 
mented on compact electronic chips llj, ll2|, which are 



inexpensive and highly integrable in communication ar- 
chitectures. However, due to large bias in their output 
voltage, they fail statistical randomness tests. They are 
a physical implementation of a generic class of complex 
systems known as autonomous Boolean networks (ABNs) 
[HI, [Hi- ABNs consist of nodes with Boolean outputs 
that evolve continuously in time according to a Boolean 
function of the Boolean inputs. The electronic realiza- 
tion of ABNs leads to the generation of analog output 
values because of the continuous switching between the 
Boolean voltages. 

Field programmable-gate arrays (FPGAs) are ideally 
suited to realize large-scale experiments on Boolean net- 
works [l5||. Typically, 10 5 to 10 6 logic gates can be as- 
signed to execute any Boolean function and wired flex- 
ibly to constitute any desired network topology. Fur- 
thermore, circuit designs can be implemented in parallel, 
to effectively multiply the bit rate. Another advantage 
is that inexpensive interfaces are available for the high- 
speed transfer of data to a computing or communication 
architecture. 

In this Rapid Communication, we show that true ran- 
dom numbers can be generated using a hybrid Boolean 
network (HBN), which consists of the combination of 
an ABN in the chaotic regime integrated with a single 
clocked node. First, we analyze the autonomous part of 
the HBN and describe its transition to chaos. Above a 
certain network size, we find that the autonomous part 
generates high entropy. Then, we discuss the clocked 
part of the HBN that mixes the dynamics of the au- 
tonomous part to reduce bias and correlations. As a 
result, our HBN generates random numbers that pass 
standard randomness tests successfully without further 
post-processing at a rate of lOOMbit/s. Finally, by im- 
plementing 128 uncoupled HBNs in parallel on a single 
FPGA, we achieve a real-time rate of 12.8 Gbit/s. 

Our HBN is illustrated in Fig. QJi, its autonomous 
part is an ABN with a topology previously proposed in 
Ref. [Til . The ABN consists of N nodes with three inputs 
and outputs assembled in a bidirectional ring topology 
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FIG. 1: a) Hybrid Boolean network (HBN) composed of N = 
16 autonomous nodes and one clocked node. Nodes execute 
XOR and XNOR logic functions with three (four) inputs and 
three (one) outputs for the autonomous (clocked) node. The 
clocking of the central node is realized using four clocked flip- 
flops. Links without arrows are bidirectional. The output 
of the HBN is a random bit stream, b) Non-ideal behaviors 
present in an electronic logic gate. 



with nearest-neighbor coupling and self-feedback, where 
N — 1 nodes execute the exclusive-OR (XOR) Boolean 
function and one node executes the Boolean inverse of 
the XOR (the XNOR logic function). 

When operated autonomously, logic gates are sub- 
jected to various non-ideal effects, as illustrated in 
Fig. QJ>. Specifically, their dynamics arc affected by 
low-pass filtering, a finite gate propagation time tlg 
(t lg = 270 ± 10 ps for the Altera Cyclone IV FPGA), 
and a continuous input-output relationship described by 
a sigmoidal gate activation function. The combination 
of these effects has significant impact on the dynamics of 
the ABN. 

The dynamical behavior of the ABN for a small num- 
ber of nodes N < 5 is a steady state, which involves 
node output voltages that are at intermediate values be- 
tween low and high Boolean voltages. Consequently, the 
output voltages satisfy a self-consistency condition of the 
sigmoidal gate activation function of the logic gates. 

In this steady-state regime, the dynamics arc hindered 
from displaying oscillations because the propagation time 
around the network Nt^q is short. Here, oscillations 
with the lowest possible frequency / = 1/(2 Vtlg) (corre- 
sponding to a single Boolean transition traveling around 
the ring network) are attenuated by the low-pass fre- 
quency filtering characteristics of the nodes. That is, 
the frequency-dependent gain is less than one for that 
frequency and all higher modes. For the ABN to bifur- 
cate to non-steady dynamics, the propagation time must 



be larger, which is achieved by increasing N. 

For N = 5, the ABN displays periodic oscillations with 
frequency / « 1/(2Ntlg), as shown in Fig. [2^,. The os- 
cillatory dynamics originate from the low-pass filter char- 
acteristics of the logic gates. The first oscillation mode 
with frequency / = 1/(2 Vtlg) is amplified and the next 
mode with frequency / = 1/ (-ZVYlg) and all higher modes 
are still attenuated. Hence, the ABN has a size corre- 
sponding to a propagation delay that allows for exactly 
one Boolean transition to propagate. 

As shown in Fig. [2Jd, the oscillations generated by the 
ABN for N = 5 have timing jitter, which is a random 
fluctuation of the phase due to thermal, shot, and flicker 
noise from each logic gate Tjj. The jitter in the oscil- 
latory dynamical regime of ABNs can be exploited for 
true random number generation, as detailed by previous 
studies on inverter oscillators [3, [l9[ . In one approach, 
random numbers are generated using multiple unidirec- 
tional ring oscillators built from ~ 1300 autonomous in- 
verter gates together with multiple clocked XOR logic 
gates. However, this standard approach has been proven 
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to be flawed 

For N > 5, the ABN displays chaotic dynamics 
as shown in Fig. [2]: for N = 6. The dynamics fluctuates 
irregularly between the two Boolean voltage levels, as 
shown in Fig. [5H. The frequency spectrum of the chaos 
(not shown) extends to ~ 600 MHz at the 10 dB drop-off 
point. 

Chaos in the ABN is a result of our choice of logic func- 
tions, high connectivity, heterogeneity in propagation de- 
lays, and the autonomous mode-of-operation. The three- 
input XOR and XNOR logic functions have maximum 




FIG. 2: a) Temporal evolution of the network for N = 5 
measured from one autonomous node, displaying oscillatory 
dynamics, b) Distribution of the time differences At between 
two consecutive Boolean transitions for N = 5, quantified by 
the probability density function (PDF) centered at zero, c) 
Temporal evolution for N = 6, displaying chaotic dynamics, 
d) Distribution of At for N = 6. The Boolean networks are 
realized on the FPGA Altera Cyclone IV EP4CE115. 
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Boolean sensitivity, meaning that a Boolean transition in 
any of the three inputs induces a Boolean transition in 
the output [2(J. Furthermore, whenever a node creates 
a Boolean transition, it is distributed to its two neigh- 
bors and to itself. The heterogeneity in the propaga- 
tion delays implies that transitions occur with a relative 
time shift, as opposed to occurr ing simultaneously as in 
synchronous Boolean networks [21[. Heterogeneities are 
caused by the inherent variability and state and history 
dependence of the propagation delay of logic gates 2 2l. 1 2 31] 
and path differences between the on-chip links. Conse- 
quently, a transition in the output of one autonomous 
node can cause three subsequent transitions, themselves 
inducing nine transitions. This cascading process leads 
to an accumulation of transitions with a generation rate 
that is bounded by the cut-off frequency of the low-pass 
filter of the logic gates. 

The chaos can be characterized by the distribution of 
time intervals between two consecutive Boolean transi- 
tions, as shown in Fig. We notice that this distribu- 
tion is w 200 times broader than the jitter distribution 
in the oscillatory regime (Fig. [2b). Consequently, more 
randomness can be extracted from the dynamics in the 
chaotic regime than from jitter in the periodic regime 
shown in Fig. 

We characterize true irregularity of the waveforms gen- 
erated by nodes of the HBN's autonomous part using the 
Shannon entropy [24| . To compute this metric, we sam- 
ple node voltages periodically with period T s = 10 ns and 
1-bit quantize to obtain a bit stream representative of the 
dynamics of the autonomous part of our HBN. 

The entropy measured from one node in the ABN is 
shown in Fig. [3^ as a function of N. For N < 5, the 
entropy is H = bit / sample; for oscillatory dynamics 
with N = 5, it is H « (0.30 ± 0.01) bit/sample. In 
the chaotic regime with N = 6, the entropy increases 
to H « (0.82 ± 0.01) bit/sample, and for N > 7 it is 
H w (0.96 ± 0.01) bit/sample. The overall increase in 
entropy describes a dynamical transition with N and is 
a consequence of the three different dynamical states. 
First, the steady state results in a constant bit stream 
that has zero entropy. Second, jitter in periodic dynam- 
ics creates a small uncertainty leading to a low level of 
entropy for T s = 10 ns. Third, the chaotic dynamics 
has entropy close to the maximum achievable value of 
H = 1 bit/ sample [lif when sampled with T s . 

The sampling period T s is limited to 10 ns, which cor- 
responds to the maximum transfer rate of large bit words 
to the memory elements on the FPGA. However, a higher 
sampling rate could be used because of the short correla- 
tion time of the chaotic dynamics of f» 590 ps, as shown 
in Fig. [5b. 

The resulting random numbers are non-deterministic 
and can be regarded as true random numbers. This is 
an effect of the mixing property of chaos, where the elec- 
trical noise that induces jitter is mixed into the chaotic 
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FIG. 3: a) Entropy H(X) = - J2 Xn ={o,i}Px(. x ™) log a px(a5n) 
of one node as a function of N, where X is the 1-bit-quantized 
voltage sampled at 10 ns intervals and px(x n ) is the asso- 
ciated probability density of X. b) Autocorrelation of the 
chaotic time series of one autonomous node for N = 16. 



dynamics. As a result, the chaos amplifies the entropy 
of the noise and, therefore, constitutes a larger entropy 
source than the noise itself 0, Q . 

To reduce the residual bias, we form an HBN that in- 
tegrates the ABN with N = 16 and a clocked node with 
four inputs (a standard number of inputs for logic gates 
on FPGAs). The ABN generates chaotic dynamics with 
a saturated entropy rate. The clocked node performs the 
XOR operation, which is known to reduce bias if the in- 
coming bit streams are sufficiently uncorrelated 0]. We 
find that the cross-correlation between every four nodes 
in the ABN leads to a normalized cross-correlation level 
below 0.075. This is low enough for the clocked node to 
generate a single bit stream with sufficiently low bias to 
pass randomness tests. The clocked node operates with 
a clock frequency of 100 MHz, it includes flip-flops that 
sample the autonomous nodes, as shown in Fig. [TJl. As 
a result, our HBN generates true random numbers at a 
bit rate of lOOMbit/s, which arc transferred in real time 
to memory elements on the FPGA. 

We implement the HBN-bascd random number gener- 
ator on various FPGAs, such as the Altera Cyclone IV, 
Altera Stratix IV, Xilinx Virtex VI, and the CPLD Al- 
tera MAX II. For all of the different FPGAs, we assess 
the quality of the random numbers with 1 Gbit of data 
using the NIST test suite [lj| and observe consistently 
successful passes at a rate of lOOMbit/s. This shows 
that our approach is robust to changes in technology. 
Furthermore, the HBN-based random number generator 
requires only 17 logic gates, which is significantly less 
than the number needed for random number generators 
based on unidirectional ring oscillators (> 1,300 [3). 

The achievable random bit rate of a single HBN re- 
mains one order-of-magnitude below that of photonic- 
based systems. However, the small fraction of logic gates 
used on the FPGA, which is less than 0.02% of the to- 
tal number of logic gate on an Altera Cyclone IV FPGA, 
allows us to parallelize thousands of random number gen- 
erators, thus increasing the overall bit rate. Limited by 
the memory capacity of our FPGA, we implement 128 un- 
coupled HBNs in parallel that have independent tempo- 
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TABLE I: Results of the 800-22 NIST test suite [Hj using 
1Gb of data (1000 sequences of 1 Mb) generated by the 128 
HBN-based random number generators implemented in par- 
allel on an Altera Cyclone IV EP4CE115 FPGA. All tests are 
passed successfully because the P-value is larger than 10~ 4 
and the proportion is greater than 0.980. 
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Statiscal Tests 


P-value 


Proportion 


Result 


Frequency 


0.7218 


0.992 


Success 


Block frequency 


0.4559 


0.990 


Success 


Cumulative sums 


0.1520 


0.989 


Success 


Runs 


0.2868 


0.991 


Success 


Long runs 


0.3653 


0.988 


Success 


Ranks 




fl QQ9 


Success 


FFT 


0.2202 


0.989 


Success 


Nonoverlapping templates 


0.8629 


0.982 


Success 


Overlapping templates 


0.4336 


0.996 


Success 


Universal 


0.2925 


0.989 


Success 


Approximate entropy 


0.1681 


0.983 


Success 


Random excursion 


0.1604 


0.990 


Success 


Random excursion var 


0.6422 


0.993 


Success 


Serial 


0.9114 


0.986 


Success 


Linear Complexity 


0.1134 


0.990 


Success 



ral evolution and, together, generate 128 random bits per 
clock cycle. As we keep the sampling rate at 100 MHz, we 
achieve a cumulative bit rate of 12.8Gbit/s. The cumu- 
latively generated random numbers also pass successfully 
the NIST tests with 1 Gbit of data, where the results can 
be found in TablcQ] We conjecture that this rate could be 
scaled up further to a rate of 1Tbit /s, if the accessible 
memory is increased, because the current implementa- 
tion of 128 random number generators exploits less than 
1% of the available logic gates on typical FPGAs. 

In conclusion, we generate random numbers with a 
hybrid Boolean network (HBN), which consists of an 
autonomous part that displays chaotic dynamics and a 
clocked part that mixes the chaotic dynamics. The HBN 
can be realized with a small number of logic gates on 
an FPGA, allowing for parallel implementation of many 
HBNs. The random numbers pass statistical randomness 
tests, as demonstrated for a single HBN and for 128 HBN 
in parallel allowing for bit rates of 12.8Gbit/s without 
further processing. With current chip technology, tens 
of thousands of HBNs can be implemented in parallel, 
opening the path towards Tbit/s true random number 
generation on a single electronic device. 
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